
9OC0HBHT BESOHB 



189 



HE Oil 716 



FOB DATE 
MOTE / 

/• • • . 

• . /• 

EDWS PRICE 
DESCBIPTOBS' 



-IDIHTIFIIB.S 
/. • ■ / . 
IBSTBACT 



Lincoln, Yvonna S, . 
, ThA Potential of OnivCTsdty-Bas«d Bureaus of 
vBes€arch: A Case stud y^^ Aggregation Analysis. ASHE. 
* Annual Heeting 1979 Paper. 

Apr 79 

29'p-; Paper presented at -the Annual Meeting cf th^ 
• Association for the Study of Higher Education 
. (Washington, D.C., April 1979) . 

HF01/PC02^1iis Postage, ^ 

♦Case Studied; Check Lists; Educational Eesfearch; 
♦Evaluation Methods; Financial Support; Higher 
Educ^^i^cn; ♦Research and Development Centers ; 
♦Researcli Opportunities; ♦Schools' of> Education; 
Oni vWf si ties . ^ 

♦ ASHE Anniial Heating 1979 * 



The potential ^for schools of educatioif> as major 
resources for research and developoent and other knowledge-generation 
aiid knowledge -use- activities is discussed, along'^ith the negative 
view of federal policymakers in this regard^. The st^dy reported here 
was designed specifically to employ contemporart organizational' * 
theory^ and ca^e study aggregation methods on the problems of ^ 
••shelteied units" or bareaus^within educational institutions, A set 
of propositions and' coun1;^fpr'opositions were derived and 1»est©d about' 
the Da tu re of the organizational climate and'^it^ function, A list of 
istruct^Jured questions and answers about the outcdmes of interest that 
could be used with each of eight case studies was- then ' generated to 
form an analytic checklist. Three readers reviewed and completed 
checklists for the case studies, making possibJ.e aggregate 
descriptions of 'university-based bureaus^, their^ organizational , 
conlextSr and ^heir potential. It is noted that most of these bureaus 
curlently have two to four staf^^members, engage in multiple 

research, development, /evaluation, disseminatipn , 
service, or research an/d field service), were ^ 
to immediate p^rceived^ needs, reside in 
doctoi;at,€-granting • institutions, and are undergoing missidn 
redefinition or role extiension, but are hindered by fiscal 
exigeactes. It is concluded that the study provided a test of the 
ra^nge c% applicability of theory relating to organizational contexts \ 
for «sh€ltfered units," and of th€ usefulness of the Lucas methodology 
in coping with data formerly? not amenable to aggregation. A 
bibiiooraphy is|included. (Aut^or/MSE) 



processes (such as 
adoption and -field 
created to respond 



♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦^♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦********^^ 

* Bepro duct ions supiplie^d by edbs ^re the best that can 1)e made ♦ 
41 , from the original document, ' * ^ * 

♦♦♦♦♦♦♦♦♦♦♦ ♦♦^ 



Ul 



v.. 



THE POTENTIAL OF UNIVERSITY- 
BASED BUREAUS OF RESEARCH:- 
' A CASE STUDY AGGREGATION. . ANALYSIS 



T 



Yvonna S. Lm^ 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 




TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERICV 



V3 

o 



FRir 



Administration , Foundation^^^'(^[igher^ 

' Department ' . \ 

University of Kahsas , . 

Lawrence, Kansas \ , 

i - 



Paper prepared for presentation at the Annual Meeting 
of the Association for the Study of Higher Education, 
Washington, D. C. ' - 

April 18-19, 1979 



*-2 



Association for the Study of Hi gher Education 
The George Wcfihlngron IMh/^ 
One Duponr Qrde, Suite 630 
Washington, D.C 2CX)36 
(202)296-2597 



This paper was presented at the Annual Meeting 
of the Association for the .Study of Higher 
Education held at the Washington Hilton in 
Washington^ D.C. April 18-19, 1979. This paper 
was reviewed by ASHE and was^judged to be tof / 
high quality and of interest to others con- 
cerned with the research of higher education. 
It has therefore been selected to be incliided 
in the ERIC collection of ASHE conference^ 
papers, ' , 



3 



It is apparent that schools and colleges of education are no longer the 
single or even central knowledge production and utilizatiqn (XPU) agency ii). 
education. Although millions, of dollars are channeled each year into colleges 
and universities for the purpose of accomplishing educational research and 
development, there are other agencies and private organizations competing for. 
the same funds. Other agencies'' include, but are not limited , to, - teacher cen- 
ters, school districts, state departments of education, federal labs and develop- 
ment, centers, and private for-profit and non-profit ^educational consulting and 
development corporations. The competition for^limited funds has been fierce, 
and the sharp loss of confidence in university-based researchers*s ability to 
answer the pressing prt)blems of practitioners in the public schools has not. 
aided in balancing that competition. 

Nevertheless, schools of education represent a major r&ource for research 
and development and other knowledge-generation apd knc i^.dge-utikzation acti- 
vities (Glark, 1977). Personnel, funds and facilities exist vhich are capable of 
being deployed for what is a high priority on most larger campuses - the. 
research function. In support of the research mission, a dean of education may 
choose from among many strategio^. One of those strategics might be to sup- 
port the "idiographic producer'\ the lone researcher who. works and writes* 
essentially without the collaborat!ive help of ' colleagues. Another strategy is 
often to cr-eate^a sheltered unit, or bureau, that has as its main -function one 
or ih'ore aspects i3f KPU. { . 

Bdre^us' have generally not been viewed by federal policymakers as having 

/ ■ ' ■ 

V , ■ 

a. high potential for research and development (NIE, 1975), although there has 
been controversy over them from the early 60's (Sieber 'and Lazarsfeld, 1964; 
Giri)a,~ 196i4, 1965; Puffer, 1967;. Stockton, 1970). On the other hand consideV- 
able evidence exists th^t educatio'ii deans see them as viaLle tacti structures 



to protect, t -augment or enhance resoar rih and devQlopment procluctivity (Clark 
and Guba, 1977). Since bureaus are part of the tactical repertoire available to 
deans, and one which is both utilized and contemplated today / it is import&nt to 
know what organizational arrangements have contributed most to efficiency and 
effectiveness in research productivity. Such knowledge is useful both to admin- 
istrators within universities, in and out. of the education unit; ancf to Federal 
planners responsible for projecting and funding education research and develop-, 
ment programs. Therefore, three primary objectives guitifei the study: (a) to 
describe university-based bureaus of research and KPU; (b) to describe the 
organizational contexts of such units; and, (c) to project the potential of such' 
units for the likely near future. ^ 

Background and Theoretical Perspectives 
'The literature fip education provides a /ich body of research and commen-, 
tary on the functioning of bureaus.. Both the potential (Sieber and Lazarsfeld, 
1966; Puffer, 1967; Rossi,, 19^6) aitd the problems (Cuba, 1964, 6-5: Stockton, 

^'l972; Corwin, 1973) are explicated in .painful detail, but blueprints for maximiz- 
irtg. effectiveness and minimizing problems have not been forthcoming. The 
controversy over the utility of .such units has not diminished with ti*ne. Both 
flossi'^ (1976) , and Hull (1^6) refer to examples which "buttress the organizational 
theory on sheltered uni^^^vhich are created in industrial and governmental 
settings to protect and defend precarious values. Such units in industry and 
government are .^Jlmost always the subject of controversy, mistrust or distrust 

'and/or overt hostility fij^m the organization at large (Shibutani, 1955; Selznick, 
1957;" Goode, . 4958; Aj^nold, 1979). Both the sociological literature and the 
6.rganizational tfieony lit^r^ure, however, support the. contentioh th^. certain 
kinds of . "elitist" values<^>vhich are aftenjpre^c^pkrtk in the context of the largejr 
organization, must be\efended and protected whenever possible. 



Selznick, in his studies of the Tennessee Valley Authority and in subse- 
quent wprk on administration (1949:^1970), discussed the role of sheltered units 
and their function. Basically, these units defend whatever values that may be 
necessary but threatened within an organization. In schools of education for 
instance, bureaus often are postulated to guard the value of research in the 
face of current opposition (such as the press for service). Selznick*s theory of 

elite autonomy captured the distrust and disdain held by the self-styled work- 

< ■ ■ " * • ■ - 

horses of an academic institution- toward researchers. In addition, the sociolo- 

gical literature on^ sub-cultures, even though it ha^ been addressed primarily to 
deviance, delinquency and marginal gi oup membersmp, prtoyides understanding 
of academic and professional group membership (Arnold, 1970; 'Goods, 1957; 
Katz, 1958; Shibutani, 1955) by focussing on membership of various power 
groupings within universities and other professional groups (i;^-^, psycholo- 
gists, psychiatrists, etc.). , 

Thompson (1^7) identified an ancillary problem for organizations that 
handle ^'unique or custom tasks*' such as universities. Their internal groupings 
assume different configurations vto perforn(l one or more^ specialized functions. 
For example, faculty members are organized into departments for housekeeping 
tasks like- budget allocations and professional specialities. But they are alio- 
cated into other groupings for other tasks, such as inter-c^sciplinary research 
teams; committee work and doctoral committee advisement. The concept of 
grouping faculty for ^eciahzed work -7 especially, in- the face of funding pres- , 
sure for team-oriehted research approaches is compelling. 

Learned and Sproat (1966) conceived organizations as composed both of the 
work environment i and associated taSJts. Human response to the groupings, 
tasks and environnhents can often Weate both; conflie^ in custom-task organiza- 
tions and differencial status des)gnat/ons attached to various tasks. Thus, 



some tasks acquire higher status than others. Furthermore, those workers 
within an organization who perform "elite" or specialized tasks often share in 
greater rewards within the organizations. Research is one function in schools^ 
of education for which high, performance is almost always rewarded. Those who 
perform well at other kinds 6f tasks (e.g., teaching or field service)* will almost 
surely be cbmhiended for those tasks, but institutional rewards and prestige 
accrue to those who do research. Accordingly the insultation of high-reward 
tasks into special units has great potential for conflict. It w* therefore impor- 
tant to know whether the potential of such units -was great enough to justify 
their creation or continliation ; whether thdre ^fere or are contextual factors 
which promote or constrict achievement of R & D missions; whether the profes-* 
sional culture supports or constrains the unit; or whether other strategies for 
supporting this> mission might prove more fruitful. >^ — \ / 



. At present, the organisational and sociological literature delineates the 
structure . and function of sheltered uni|t3 in .industrial and military, but^ not 
educational, settings. However, neither a general theoretical description of 



bureaus nor explanation exists for the organizational featurenjjjj^berent in educa- 
tion unj.ts that enhance or inhibit mission achievement (Cr-rvvTr), 1973; Gtiba and 

■ 0 

dark, 1975; Clark and Cuba, 1977). X. ^ , 

. . ^ . ./^ %■ J / 

Compounding the conceptual drought is a failure in metKo'dology.- Various 



means of testing assumptioji^and hypotheses about organizational ^contexts and 
bureaus have ' not. proven particularly useful. First, the investigations illumi- 
nate neither the range of external noV internal factors impinging on effective- 
ness. Second, the stbdies generally have not^^^ded^eduea^^ administrators to ^ 
plan 'for better R&D utility and optimal attainment. ^ ^ ( 

^The present study^ w^s designed specifically to employ contemporary organi- 
zational theory' and case study; aggregation methods on the problems of Shel- 
tered units or bureaus wipin educational instituti^s. Traditionary, bureaus 



have been studied either with case sLudios or with single in-dqpth observation 
forms. The results alhe isolated case studies and other historical .evidence 
lacking theoretical •gtnaralizatioos. Therefo^^>^^tudies df such units have been 
severely ^ODnstrained by the absence of a methodology that permits comparison 
^ of documentary, analytic and historical evidence. A method does exist, how- 
ever, that possesses ^t least modQrate^ usefulness for comparative analysis and 
subsequent theory development. 

> 

Case Study Aggregation Method 
William Lucas (1974a; b> proposed a methodology that makes possible^^e 
comparison of formerly non-comparable case studies. * The case study aggrega- 
tion method is particularly useful because it allows the aggregation of studies 
that are usually "non-random, diverse and qualitatively Jdneven. " Moreover," 



this is accomplished in such ^ manner, tl^at new insights may be drawn^rom 



already existing research not intended 



for the new purposes (Lucas, 1974b) - 



Lucas descried the methodology a^ follows: i 

. . . " the \case survey method... [draws] research together to iden- 
tify what it' L0*^Y%^ already "know," what it' is we do not know, and 
,.-what if is we luspect. . .the case survey approach is particularly ' . 
i appropriate . for thej;^ review and summation of ^ case .experiences, an . 
important type o^'^olicy research literature. Case studies of local 
programs and ag-encies* are valuatlq, becaus'e they are a major compo^ 
nent of many policy research literatures, they are rich in information, 
and insight,' and there, are ^so ^any of them*; Millions* of dollars- are 
spent each ye^ on modfest evaluations amd reports on the activities of 
\_ local rproiects . Ye'^lthey are found scattered and isolated in govern- . ' 

ment\ repbrts, consiiltant evaluation^ ahdy academic .publications that 
neither address ^lor Vebilt findings of earlier case studies. The case 
survey method . was (developed as a means of bringing divers^ case . ^ ' 
smdies\ together . under a common conceptual frarhewof^k so that the • 
findingi^ ^ill b§ cumulative. ^ \^ j | 




In applyincf the method, Syfirst ^tep is to determi^ wh^t the phea€ 



imenon 



under investigation is. In this case, it was burets, centers or ins^tutefs 
devoted to a variety of knowledge ♦ production or uttlization^unctions, /and 



□eve 



ERIC 
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, located withjn educarion units. ^ list of ^the phenomenon's outcomes and - their 

"^""^ " - , , 

possible determinants are organized under a broad set of conceptual and theore- 

t|cal rubrics. In this study, the rubrics were drawn both from previots bureau 
studies and from organizationaLtlieory and research literature.' A set' oj^pro- 
positions and counter-propositions wejge derived about the nature of the organi- 
zational climate and its function. It was these propositions and their inverses 
which were to be. testetl, . For- example, two propositions 'and their count^r- 
. propositions were: ^ ^ ^ ^ 

V ^ 1. Research is a faculty pri- ^ 1. Teaching, not research, is 
r \, ority, ai:id 'whdji allowed to a faculty priority,^ in all ' 

\ ' choose,^ fafculty member^ over- *^ classes of in^itutions except 
whelming, will choose research 'private, doctoral-level, 

over teaching (Sieber" and research-orifented institutions 

Lazarsfeld, 1966). ' . ' „ ^ (91ark and Cuba, 19'J7). 

2. Research bureaus shoiUd * 2. There is always ^ tendency^ 

not emd must not turn awiJy . for organ^zarflons of a n6n- 

fromAesearch and do service, ' \ profit nature, to^turn away,^t 

or experience "gxjal displace- i \^ least partially, from th?fr . 

'mental ' ' -^^^ \ • ^original goMs^^^or ^o suffet 

^ ^ • i • "goal displace\ent" (Berelson 

' / . \h and Steiner, .1964),' ; ^ 

) ■ • ' ' I 

h second step in the inquiry was to generate a list of highly structured 
istions and qnsw^rs^ about the' outcomes of interest which could then bemused 
with 'each c!ase ^tudy. Those questions'^flfd answerstform ayi/analytic checklis 
The possible answers fo each of the 'questions are delineated in such a way 
each ^^^;id^r of the cas.e studKcan make the most appropriate response to|the 
^question, jjin addition, each qjue^tion allowed the reade^- to indicat^ whether the 
case study contained no information on that question, and provided for ck confi- 
dence level rating of his response. The confidence" level rating indicated the 
reader's certainty that the answerXprovided was accurate. Additionally, it 



alK) 



wed the analyst to examine further rhose responses of Itigh certainty. 
The next step included identifying the universe of bureaus and identifying 

from among, those the units'^ with .documentary evidence on their organizations. 

• i ■ ■ ■ \ ^ ■ 



Ideally, the>^^niver^e.o|ught Jb includo .ill units, although the number of bureau % 
directprs Who reported ^ no .such evidence e^isted^ ran to 20% of all units identi- 



4L 




fied*. Data for.-Uiis study were case studies, bureau histories, annual reports, 
v' budget «and personnel requests , and accreditation, studies solicited from deans -, 
awl director^ of such units. SCDEs^ identified as having such a unit, or plan- 
ning to create one, were identified in the RITE Project Sttidy (Clark^and Guba, 
1977)-^ Ten case studies existed in project files prior to , the solicitatioTi. A 
total of 93 'additional requests were made for bureau ^oeuments' to deans 
bureau direct4};'s. Responses 'were received , from ^67 (72%) administrators, but 
. 19 (20%) iJad no documents and 14 (95%) stated such reports w^re confidential. 
A total of/ 34 (37%) • returned -thi^ documents. Oj these, 14 (16%) were complete 
and disable) This 14 and the lO^origin^l casp/^udies or. a ^t^l of 24 comprii&ed ( 
the i^ample. . Y - /^Tf — ' " ^ . ) 

Of the<-total returned, thebe^were 16 (16%) that wer^e^^t^ techhic^U^ or 
methodologically inadequate.- ^nat is, the documents were poorly written, con- 



sisted only of a^ ^o phu^ for client use, or failed^o deal with one 
the 'fiv^ outcdmesyufinter^ to. the' res^ f fc ]}^^ ^fie outcomes of interest Xere, 



firt general terinj 



(i a) goa5 



s and missions of bureaus 



processes or 



tuncti 



tions^ 



c) activities ana roles of faculty ; d) unit ihteigration (with remain'der. of* educa-; ^ 

tion unit); and e) worker^ motivation, pefceptions^nd" newards. ( 
As might -be expected), , those case studies solicrEed were largely (95%) from 

doctoral-level institutions. It is "exactly that soft qf institution Wliich Wovides 
. that climate which most often favorsj values and* rewa^s research produ\^vityir'^^ 

It is also' most often the larger doctoral-level institutions which have greatesx 
. flexibihty 'in deploying resources into suc.h units, and ^which is mo$t .likely to 

eith^ h'ave bureaus in existence alr^e^y or^to be contem^afitf^ the creation of 
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The* case, 'studies utilized for this study fairly obviously did not comprise 
, the universe' of such studies. Nevertheless, ^om fairly recent research (Clark 
- and- Guba, 1^77) on what institutions tyVcally have bureaus.*, want them or plan 
to create them/ A^jfvas inferred that the 24 cases , utilized v>ere a fairly repre- 
sentative -"sample . / • / 

In the seaj:;ch for case studies from the ^ probable universe, ]d.ecisiori. rifles 
were. -generated which guidec/ both the search and sa^npling^ procedures. Choice 
of. case studies, Sampling parameters, and probjems of bias,* as well as decisions 
not to and reasons^ for excl\ision, must be made .eXplicity.by a set of 



decision rules which serve two purpos^. On' the one hand; .they make explicit 
to the checklist readers and analysts the guidelines and definitions which latruc- 
ture the study. 'i)n the 'Other hand*, |:hey clarify to the audrence criteria for 
decisions to aggregate, include and exclude. Where decision rules treat extki- 
sion, particularly, examples of methodological or technical inadequacy o^ugi^J;^p . 



be included. 



Methodology, Bias gnd. Reliability . Problems arose in' the\^tul 



when fe^rtai^ 



became *'noisy", IfrM. is, when .questions^ arose aboiyc the /accuracy ^or vali- 



y ( 

dity of the case studies 'themselves. Noise in the dati!i was'^tributed to two 
biasin^'^proBlems, tepmed timing bias and balance bias. \ 1|J 

TJie ^pi^pblefnO^f timing bias relapd to th^ year In ^^hich the documents 
were prepared^ In 6yer half of the-* cases , ' the case study" m^iteri'als were pre- 
iJared^rior to 1971^^...-,^ ^'^^^} °f ^J^^ studies, it is likely they^- 

reported conditi^s ^both interjffal and external to the bureau and SCDE which 
have been dra^ically altered 'within the last half-dec^e or more. Both termi- 
.nology^ and undei'standings of KUP activities- have chansleaand levels of sophis- 
ticationjj^cortcerning the variety and scopepf^u^h missions Iroye been broadened 



f 



-imd deepened. The' futurfe of ed'uGatioii^il KUP in 1969-70 may^ot look like the 
inunediate p^isU of 1978. ; - 1 ' * . ( 

balance bias posed another difficulty ^VjWiLh respect tg^ demographic data^ / 
thc^; reports were assumed 'to be fairly reliable. The numbers ol staff , grarfiiate 
assistants, refereed papers, and presentations, cmrd--vthe level of current and 




•projected fiscal resources were easily verifiable pn an/internal basis. Those' 
jiata, however, which might- be termed "perceptual" were deemied more subject ' 
to manipulation for politipdil purposes. The case §tudies themselves were often 

prepared internally, acidressed to certain constituents and designed, to serve a . 

' i ■■' • ■ . ^ ^ - • ■ 

' varifety of ^ po^verful and sophisticated j)urposes, ^such as ; accreditation ^ and 

budget psqyests. For that reason, strohg positive projective tias Imely in- 

h^red'^ (Lincoln, 1977). ^ ^* . v ^ ^ 

^ 1 ■ ■■ 

' Those* data .more amenable to bias probably tended to lead to occasionally 
erroneous conclusions, i^e., to inclusions contrary to fact. Lucas has stig- 
gested two . ^possibilities . for determining reliability in instances such as this. 
The first is to use the^ frequent duplication available in the' literature and to 
complete checklists oi^^^o' different- observer's repferts (two case studies .avail- 
able on the'^ame bureau). Wher^e^^o existed, \_this was done. The agreement 
•betweeiv checklistscl^jlAia^. thj^il)s(re j"a • measu'r^"^^of-> jfe^^ combinied observei^^Hnd 
V reader reliability'* (Luc^ST^j^^T^b^ . 

A second way to determine observer (case study writer) reliability was to 
perform /fiel(J checks. By^ gathering Ifield observations from those whq were 
part of the original program or unij^'^sing the same) checklist questions employed 



by the readers, sy)arate checiclists can be completed ,fbr each program or 

J ■ 

bureau. This form c 

bias/' (Lu{as, 1974b) > • - . . ^ 



bureau.^ This form of^reliabil/ty check provides useful data' oh the "possible 



Since current\ observations are fresher tlx^n memories of times past, the separa^ 
tion otjp^Fesen^^ events from those pasUi^ importanj:^ b^^^ reliability may 

beo]3t^ed.\ Y . - J 



The.^paVticular -Study was^* cpnslrain(»^ by an inabiiityno 'colL&€4jid^ in the 



fifld,^\ln thi 



is "Qase, a relatively .simple but irhportant ..adaptation was utilized, 
i4i^e'^ pi*esent . study gr^ out of the larger ongoing ' RITE study (Clark and 



the 



Gyba, 497;3V* ^19777; VhicH ^generated considerable information ancillarj^to 
central thfugt of, that study /.but -C^ral 'to thfe outcbmes" of , interfestA^nh. this 
p^e^ent inqilii^: . ."V \ ^ \ • ' / ' :^ ' ^ , ' * • 

\ 'L^^^hefi it)\hecame' evident\hat somewhat older projections and predictions did 
^not' jBXhiblt 'congruepre wjtH contemporary states-of-affairs, or when current 
research- 'contravened less- recent- case studies evidence .was subjected to the 
Vcurrei^ realities" test. That is, data that \ver^^^erated Jpy the case stu($fes 
were compared to newer research as a mean^ of establishing/observer i:^elia- 
bililV/ and testing for positive "projective bias. In some instances, of /ourse, 
case studies writers were not to be^ faulted for their genferous and optimistic 
future projections. In other instances, however, case study writer (observer) 
projections were overly optimistic given the near, clear future. That slightly 
positive bias, especially with respect to institutional levels of^ support, discr>^ 
tionary -funding, an^i proposed programflhatic ' thrusts, was accounted for Isy the 
equivalent of field reliability checks. 



Analysis of Data 

Three' readers were chosen, all of whom have had either ^^^osrS experience 
in educational administration or direct experience in bureaus and research 
units. The readers retviewed with *the analyst the purpose of the study, the 
method, decision rules and all definitions of concepts for two days. At that 
point, each of the three readers completed three sample case study checklists 
for .whi^ the analyst had already ascertained the "correct" or most likely 

- ■ • . ' 

Funds available for travel were severely limited. 



^ - ■ t 

answers' (the?' analyst, as principal invcjsii^atoi:, was ^presumed to be /sufficiently 
expertsfCo provide the. criterion estimate;. Th^ percents of agrr.eememts provided 
an estimate of mterreader reliability. 

A 33' percent agreement (or 22 of '67 questfons), -either bet^veen. readers ^or' 

• ' ^ . • . _ . . ' ' / 

between individual readers and the analyst, might^&e ^expected s01§ly by chance 

since* ^aach item had at lea#t J;hree possi451e response ^ categories . Standard 



) = +7.56. The 
5 = 29.9Q ques- 
Thus, agree- 



deviation at the* .05 percent level" of tftnfidence was\l.96) (3,8 
expected chance agreement would "then not exceed 22-1/3 ^ 7.5 
tipns. Converted to percent, this number of items was 44.6%. 
nient on 44.6 percent of the items would be expected by chance or fewer than 
one time in twenty^ . . 

In actuality, ^percents ofV^greement both among the readers and between 
readers and analyst wfere far ^bove the chance level. Between readers A and 
the percent;of agreement was 72; between read^ers B and C, the percent of 
agreement was 89; and between A and Q, the ""percent of agreement was 71. 
Between the analyst and readers A, B, and C, thej)ercents of agreement were 



/ 



69, 76, and 91, respectively. The high level of agreement^ between the 'analyst 
and reader C was thought to be attributable broth to increasing sophistication of 
training the* readers and to the sophistication' of reader C, "v>^o is gilrrently 
employed lit* a bureau setting. Familiarity with both the contemporary bureau 
setting and^ with organizational contexts appeared to reduce error and raise 
reader reliability greatly. All percents of agreement, which represent readier 
reliability, were well beyond the realm of chance (Lincoln, 1977). 

For this st^udy , all readers completed checklists on all case studies , 
although if the universe Ifc^ studies is large, that need not be necessary if 

V 

reader reliability is well established. Once all checklists were completed, discrer 
pancies weTe adjudicated ^ by the analyst/4nd responses scored. 



Confidence Ratings, . \ ' / 



yr Each • question on* the . ai)alytic cliecklist had a confidwMPe rating scale^ 
(tikert-type) en which the reader /analyst coulU .indicate his level of assurance 

' ' • - ' ; ' / - 

tljat the case study addressed ^he question ujprambiguously/,. JThus,. the co^fi- 



* dence" rating could be used to assess whether responses to individual, questions 
^ were based on clear ^statements, statements^^or which there might be maritiple pr 
ambiguous, mfeanings, pr .simply iriferen^. These.^ ratings in effect assign ^ 
, '^certainty" level to ^reader /analyst answers. Confidence level rati^ngs exhib^ed 
,^^^^igh levels of congruence^ across readers.. In other words, when ca^ studies 
were explicit, readers were uniformly confident; when 'cases were ambiguous or 
unclear, it was obvious to all readers. The corhplete »set of propositions and 

c 

counterpropositions generated/ follows. Beside each is indicated in summary 
fashion whetlrar-the proposition or its counter was suppdrted. AH propositions 
(U§^te3 as ^-^a's") are ^ drawn out as disembedded assumptions from Sieber arvd^ 
Lazarsfeld (1964), ' / ... V ^ 
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Propositions and Counter-Propositions 


Proposition 
Supported 


t Proposition 
, Not Supported 


Insu|ficient 
Information 


X. a. Research productivity is a • 
V . ^ shared *value in SCDE's, enjoying 
* sympathy and support ^in all its 
i Manifestations by most 'faculty . 




- X ^ 


\ 


/ b. Research is a tenuous or 
\* ^**precario.us" social value, which 
'must-'dt least -be protected by 
elites (groups within the 
organization responsible for 
- . protection ^of sbci^ values); 
at wors^t, special saftfguards 
nrtust be created to defend^ the 
^ value (and its protectors) from 
J ^trong groups with similar* , ^ 
. 0 responsibilities who might attack 
it. , (Selznick, 1949) 


■■ s-^-; 

X 

t 


* 


\ 


II /' a*. Research is a faculty priority, 
and when allowed to choose,* 
, " .faculty members overwhelmingly 

^will choose^ researdi over teaching, 




• X ' 

7 




b. Teaching, not research, is a ^ 
faculty priority, (in all but 2A 
institutions). (No "released 
time" for teaching, only Yor. 
' . research.) (RITE,' 1976) 






f 




I ■ ■ 
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Propositions Cont. 



FYoMsitidn 
Supported ; 



Proposition 
jNIot Supported 



Insufficient 
Informatidfi 



III. a. Bureaus are, and can continue 
to be, sheltered worksHopgF k'^. '.f 
' housing intellectual ^^^ggititar cass . 



b. Bureaus may not be able, in 
the face oT^ternal and interjial 
pressures, to venjoy the status of 
protected'.umt,^ i.e. ,r fiscally 
protected, protected in terms of 
the* reward system, ^j^totected 
from the hostility of extra-bureau 
'faculty, (Cuba, 1965) 



IV. 



a. University-based research 
organizations grow out of the , ' 
needs 'of researchers to increase 
their own opportunities for 
serious scholarship. 

4- 



b. Since serious'' scholars, 
especially those v^ho are able to 
garner external funding on their 
own, are reluctant to affiliate 
with bureaui^, which they per- 
ceive as draining off resources 
from research monies, i.e., over- 
head expense, e^. (CampbelT 
Report, 1975), bureaus are likely 
to be set up for other kinds of . 
reasons and by other* agents 
than groujjs of scholars, e.g., 
bureaus as "holding companies," 
bureaus to fill stimulation and 
behavior-modeling roles, bureaus 
to shelter andF,defer>d "precarious 
values," such ^s research and so 
forth. (Clark & Cuba, 1975, 
Selznick, 1970) 



J 
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* • ; ' ■ 

,v Propositiorts Cont.- 

• / T- 


Propositjorf 
Supported , 


(, Propo&itfpn ' 
Not Supported 

IK, V 


1 

Insufficient 
Infoi^mation 


."" * V. a. facility dl)ing exclusively of 
. ^ p Fluid X ixy 1 cQcpx cn wxxx enjt'y txie 
V ' support and encouragement of , 
their non-bureau^colleaguesyare. 
not ^ng^ged priir^pirily' in. » - who 
, *v research* \ ' ; . ^. • 


■ V. 


J 

\ , 


^ / 

7 


■ . Faculty who engage eKclu-% 
r^^!6jiY Qr even 'only primariry 'in 
./ X^^^^^h <vill no^ always erijoy 
— / j support or encouragement; of 
, tlieir^ colleagues. (Guba, 1964) 




— ' 






• . - /I 
- .. ; ^ ^7 

^ »; • .VI. a' When a researcher is only a 
^ ' * part-time researcher and^ia 

part-time teacher, research ar\d 
teaching are both compromii^ed. 


■( 


\ . 

x' ' 




». * iT" . ' — 

^ i0l Neither research nor teaching 
>%jf^y Gre necessarily comprqmis'eia 
'^"-^ when a faculty member engages 
\ in both. ' ; ' 








^ Vll. a.^An organization's "true pom- ^ 
^ mifiteents" (the demands t^at are 
. ' placed upon it ir)ternally and 
ekternally) are unchanging-. ^ 


J 

\ 


■J 

X . ■ ' 




y ^&tr b. An organization's ^'true^om-*^ 
-'^i*}' mitmehts" are not unchanging. 
(Selznick, p. 73) 

: : ^ 

i 


X 


J 





/ 




Propositions Cont, j 


Proposition 
Supported 


Proposition 
Not Supported 


Insufficient 
. Information 


Vin, a. Research bureaus should not 
afid must not turn away from 
research to do service. (S) 

— : : ■ < 






/ X 

i 


' b. There is a tenderjcy for 

UX yctlli^Cl LiUJl a JlUJl pXUilL 

character to turn away, at 
. least parti^y, from their ori-^ 
■qinal goals, or to suffer *'goal 
.displacement," (Berelson & 
Steinfer, 1964). / 


N 


1 


X 


" — — ^ ^ \ 

X . xA. • ^ ci • OcFViCc lIlLcXicXco WILXI 

• . research/ * 






, , • t . 
m 


b. Seryice may not nece^isarily 
interfere with research . The 
relationship,' at best, is unclear. 

-U. 1 


X * 

4 






• X. a. Team, especially interdisci- 
plinary research, is betttr than 

XicoCdXdi Liuiic xjy j^xiiyic 

Individuals. ^ 


--(^ 


« 

• . X 




b.' Team- type research is not 
necessarily be^er than r^earch 
, ' * done the lone researcher. - 


X 




0 ' ' ' 


I 









0 



; 



\ 



Propositiort& ^joht , 



Insufficient 
Information 



XI. a. Faculty can be persuaded 
, do team-mode types /of 

research even though profes- 
sional socialization enlcourage^ 
and rewards the "lonp 
reseafcfeer*J. (S) 



ired. for 

that function, liaculty will not , 
engage in team-rhode research 
if it endangers their standing 
or advancement withij^ the ^ 
reward system. (The ma^;e^ 
closely the member holds to yie 
organization's professed x^lues, 
the^more likely lie is to Be 
promoted within the organi- 
zation.) (Berelson & Stbiner, 
1964). . , ^ 




3. ^ 



'Xlfi ai '^^he reward systfe^s of uni- 
v-ersities are, orr will-be, v. • 
aqcomodating of mui^ple n[iode^ 
of research (i.e. , teamwork 
modfes). . 



b. Reward systems of univer- 
sities are, by and large; not 
multiply-fo,cu\ed, but single- 
focused, rewarding theilone Jh 
researcher. ' ^/ 0 



. \ V \~. ' 

XIII. a. The aspircltiongi of deans for 
additional /full-time research 
faculty h^ve validity, in the re^l 
' " world. / . 



b . '.The "Aspirations- of deans 
with resp^t to hiring 'fulltime 
researchers does not have . 
validity in the real-' wprld . 



Propositions Cont. 



Proposition^ 
Supported 



Proposition 
Not Supported 



ifficieht 
InforiMtion 



t 



XIV. a. When deans express a desire 
for more i^esearch faculty, they 
knqW what they waht and under 
stancT^lly what the costs are.. 




IS .do pot j^novy what 
\vant; they do jio.t fully 
mderstand the costs, either 
economise, or psyche-social,' of-, 
having full-time reis^a^chers in- 7;' 
their units. 




a. Faculty will support the ^ 
aspirations of dreans in hilling 
educational researchers . • / ^ 



-Faculty will not support the 
■ piratio^s of , deans in hiring 
1 researchers . 




r 
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* Conclusions dii d Discission 

* ... ~ ' ■ ■ 

A Description of University - based Bureaus . The days pf whcrt: one .person 
calfetskj^those mythical Midwestern bureaus" ^re largely ► over / Most bureaus 
these days hgve between. 2 and 4 persons FTE; including clerical help. ^More 
than 'half «K)perate with x^nly pnk graduate assistant if they have any at ^\f. - 
They are almost without exception multi-process units, although they may 

■ ■ ■ • y . -y ' . _ . 

have a programmatic substantive focus (e.g. Center for Urban School Studies). 

n ■ . ■ 

THey often engage, as stated, in multiple processes, such as research, develop- 
ment and evaluation,/ or dissemination, adoption and field service^ or research 

and field service. • f 

^ • » • ' ■ ' 

Most of_the units created within the -last eight to ten years have been 
created on an a d^ ho g basis. That is, they respond to immediate perceived 
needs or n.ew thr\uHs in the field (e.g., the Center /or Ecological Education, 



the Institute for MoraX Education). They often have Jbnly small facilities, and 
the major resources ' committed to the operation ares^us^ally in the form of one • 
parttime clerical assistant, one graduate assistant, and one fulltime facility line. 

' A number of the newer bureaus are required to justify their existence on 
an annual basis. To the extent that they are unable to capture outside! funding 
(from any of a variety of sources), and thils may not be able' to^sj^tain all or 
a portion of their operation, they are allowe^ito wither away! 

Most, although not all, of these units reside in institutions which give the 
doctoral degree in education] About ' half of the sample included former 
"teachers" college" universities, which .are moving increasingly toward expanded 
giefinitions ol faculty roles (to include research, development, and the like). 

Well over half of the units^ had as one of their main functions .the coordina- 
tion, facilitation, or technical advising to research and development projects. 
These functions were to be extended, by common understanding, to any faculty 
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» ^ 



member^.iWto might need the ^serviii^, w^f^kther of not s/he might *hc assigned to 



the Bureau 



Many of these ui^it/ aj^e vindej^oing missK)n redefinition or extension if f 



their former rolts. They are moving <lnore heavily' in^o service functions, 
toward extended knowledge utilization functions (i.e. , installation, adoption, . 
school plan|iing^ change agentry, linking functions and the like), and toward 
more ad hoc activities (I.e., v^'rkshops, school evaluations, on-site in-service 

education, etc.). TheM are attempting to respond, however weakly, to the ^ 

.... ' . \ ' 

pressing needs of public school personnel. ' ' 



IChe Organizational Cjpntexts .'^ The first of four major propositions wa's that 
significant potential opportunity exists for the bureau to be* perceived with 
envy and distrust or as deviant frorihs^e normal organizatioi^l pattern of the 
school of education. l^everthelejss, evidence df such perception was notably 
absent. For instance, only three units i^eported any extra-bureau hostility, to 
their operation, and ^ more than half (17 of 24) reported or implied fairly cordial 
relationships between the . bureau and the pst of the School of -education 
(several also did not report any inforirlation on this variable). Those ^units 
wl^P^i described as one of their mission I areas the facilitation of non-bureau 



member research or development activities i^epor^^ both the largest incidence of 
non-member affiliation' for' such activity and the most cordial relationships with 



the rest of the school or coll e^ of education. But a number also reported 
some difficulty in securing faculty^to work'' on bureau projects (9 of 24). Some 
evidence also exists, however, to suggest that the value of such units is not 
widely appreciateid , nor are the values .they embody widely shared within the 
larger unit. 
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Although' it is suggested that the JMren ^ong** of service may on occasion 
interfere with^^eresearcti function (Guba,'al965; Sieber and LazarsfeldC 1966), 
there was n9 evid^ce ^hat most byreaus endured ^xjiesstve drain o^ their 
resources in fulfilling this, mission^ The Case sixxdy writers occasionally indicate 
that service- dibiands 'are high (five cages), t^at suph. /demands are increasing 



(six cases) ^ and that reque§ts for s^e kinds of service are occasibnally turned 
down (five;^ 'cases) either for lack of time or for lack of personnel, "^"fetit ^n no 
cases did wi/fters of the case studies indicate that sefVice interfered with, or 
ImpingofiL upon, time for research. In. only , two cases did case study writers 
commbfiit that service dema^s di^ained, personnel away fror^ researcT^ 

The professional school culture that socializes new professionals to the 
"lone researcher" mode Kas not changed over the past 20 years (Sieber and 
La^arsfeld, 1966; Stockton, 1975) . Thus newer programs of funded research, 
which call for intra- ' and inter-disciplinary/ programmatic, intensive team 
approaches are still neither comfortable nQV stable approaches in 'most institu- 
tions over the long term. Further, scant evidence exists that the training and 
socialization of graduate students, either to newer approaches or to new. and 
emerging roles, has increased significantly. In only two case studies did 
writers indicate that ^graduate students assumed major responsibilities for pra-^ 
jeqts undertaken by the bureau. In all pther units which hired graduate assis- . 
tant help, those students were' assigned at best minor apprenticeship roles and 
at worst; clerical duties related to projects. 

The Potential of Such Units . Fiscal exigencies have .left bureaus and research 
units in an ever more marginal position within the larger unit schoql of educa- 
tion. Increasingly left to fend for themselves in an RFP market, they have less 
and less time, personnel and resources to devote to long-range inquiry on" 



fundamental educationcil problems • As a result,^ they have been largely dealt 
out of the iftajoj^^search/KPU functions 'for .which they weVe ii\tend^dr^ 

. - '. 

m • \ 

» * ■ * ' ' ' \ ^ 

' ' *. Importance of the Study / ; \ , 

The Study makes three jnain contribution's to educational Research. First, 

• >.■•• ' ' - ■ ■ ' \ - ' ■ ^ 

it has incpfeased the fund of knowledge about R&D units or \burefaus jioused in 

^ . . .\ ^ 

schools, collc^ges and * departments of education, especially a,s that knowledge 

relates to organizational arrangements which enhan'ce, facilitate or inhibit pro.- 

d|lictivity. / Second, the study provided a tes^^of the range .of| applicability of 

theory rejT^ting to organizational contexts for such /Sheltered units". And 

third, the stud^ provided for a tes^f the relatively new Luca^ methodology. 

Which had not been utilized with a collection -of case studies f^om education. 

The third contribution is perhaps the most important, since it validates a 

new tool for researchers who 'may need or wish to cope with bodies of material 

•■; ■ t . V ' - , , ,' ' ^ 

already in existence which formerly would not have been amenable to* aggrega- 

tion. Now abl^ to aggregate random and diverse case Studies under a set of 

common conceptual rubrics, the researcher m'ay utilize materials which were 

'insightful but heretofore -unusable exgept for highly specific purpose's. 

One examnple of k rich case study rnaterial which comes ,to mind is the 

panding number of program evaluations. Even when the programs are the 

* i 
5me, but in different locations throughout the c6untr}^often evaluati()n efforts 

do not produce /Comparable--aijd therefore meaningful— program-wide results. 

• . _ U., . ; ^ 

Jhe case study aggregation, method^ conducted as a form of evaluation audit or 



meta-eyaliaation, can aid planners and program directors in drawing 



available research systematically and [establishing] what... it is we already 



♦ r 

is we do ji( 



'know', what it is we do tiot know, and what it'is we suspect... so tha 



"together. 



. findings 



will be cumulative" (Lucas, 1974b). The addition of such a methodological tool*^ 
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' to the repertqire »of researchers greatly enhances the probability that findings k 
. • >will be ''significant. In addition, it ensufTi^^TTiat research costs Vill be ultimate- 
ly 'lowered, sin^a generation of new/ research will .not bd* necessitated in order 
^ *to produce comparable results,. 
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